Vector completion mask handling

ABSTRACT

Techniques for vector completion mask (VCM) handling are provided. A data structure includes a mask field for each operand of a particular operation. A processor attempts to execute the operation with multiple operands, which are identified in the data structure by the mask fields. If operands are successfully retrieved for execution with the operation, then the corresponding mask field within the data structure is cleared. The processor can reset if any field remains set within the data structure and can re-process the operation with operands that were not previously handled with the operation.

BACKGROUND INFORMATION

Vector computing is a technique that entails executing a singleoperation while operating on collections of multiple elements orelements in arrays, or “vectors”, with that single operation. A vectormay be characterized as a list of elements (or “operands”) processed byan operation. So, a single operation can be executed once with multipleoperands, within machine architectures designed to perform vectorcomputing. For example, if 6 numbers were to be repetitively addedtogether within a program via a loop programming construct; then, ratherthan executing the addition operation multiple times, a vector processorcould arrange to process a single addition operation at execution on all6 numbers at once. This provides processor efficiency and increasesoperational throughput.

The benefits of vector processing include: 1) a reduced number ofinstructions needed to perform an operation on multiple operands; 2)each vector instruction may indicate operand dependency to processinglogic, which the processing logic may exploit to increase processingperformance; and 3) vector processing enables greater parallelprocessing of data.

A “mask” vector having the same number of elements as a vectorinstruction's operands, can be used to specify which of the elements ofthe vector operands should be operated on. This is especially beneficialwhen performing applications code with conditional statements usingvector computing.

One challenge with vector processing is in the area of memoryoperations, such as vector loads addressing virtual paged memory. Inthis case one or more of the operands may not be available in memory forthe processor to handle at the time the operation is executed. With sucha situation, the processor flushes its contents (restarts) and attemptsto acquire the missing operand and then attempts to process theoperation again.

In virtual paged memory systems, the actual physical memory in thesystem may be over-subscribed and pages that do not fit in the physicalmemory system may be stored elsewhere, such as on a hard-drive. When apage is needed that is not currently in the physical memory, it may needto be acquired from the hard-drive, for example, which can adverselyaffect processing performance.

Since the element in a vector can be read from multiple locations inmemory, a common situation may entail several restarts before anoperation is successfully processed. This happens when elements that areloaded into a vector are located in different physical pages that needto be acquired. However, during each restart the processor is not makingany forward progress on the operation. That is, no results or runningresults are available until the operation successfully processes withall the operands at once. Further, the process of acquiring additionalelements may displace the first elements acquired. Hence, we need asystem of incrementally completing the operation, so that forwardprogress and efficient processing is guaranteed.

The current invention allows a novel and efficient handling of theprogress that is done for each attempt to execute a vector operation.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a processor to perform at least one embodiment of theinvention.

FIG. 2 is a diagram of a method to handle and to manage the completionof vector operations, according to an example embodiment.

FIG. 3 is a diagram of another method to handle and to manage thecompletion of vector operations, according to an example embodiment.

FIG. 4 is a diagram of vector completion mask handling apparatus,according to an example embodiment.

FIG. 5 is a diagram of a vector completion mask handling system,according to an example embodiment.

DESCRIPTION OF EMBODIMENTS

FIG. 1 is a block diagram of an example vector processor, in which oneembodiment may be used. In one embodiment, the processor includes frontend 100 that fetches and decodes instructions, an allocation unit 101that allocates processor resources to execute the instructions,execution units 105 that include the functional units for memoryoperations and non-memory operations, in one embodiment, a retirementunit 110 that checks that instructions are correctly performed and thatthe result can be commit to architectural state. In one embodiment,vector processor may include registers, such as a VM (vector mask)storage register 115 and aVCM (Vector Completion Mask) storage register117.

In one embodiment, the VM and VCM registers specify which of theelements of a vector should be operated upon. In one embodiment, VM andVCM registers may store Boolean vector values of the same length as theoperand vector values. In one embodiment, bits set in a position in thevectors indicate that that the corresponding operand should be operatedupon and other operands should not.

In on embodiment, VM register bits are set by vector conditionaloperations, whereas VCM register bits are set by the retiement block aswill be described. In order to maintain the correct state of the VCMregister, other instructions may read and write the VCM register asappropriate.

In one embodiment, VM and VCM registers are programmed with theappropriate mask and data values according to an instruction beingallocated within the processor. In other embodiments, VM and VCMregisters may be programmed with the appropriate mask and data valueswhen the corresponding instruction is at other stages in the processorpipeline. The combined VM/VCM mask follow the operands through theexecution units so that only operations and updates that are forelements with a corresponding TRUE value in the mack are performed.

In one embodiment, in which the VCM register indicates Boolean values,only instruction operands corresponding to a “true” value in thecorresponding VCM mask may be operated upon. In one embodiment,instruction operands that have already been operated upon by aninstruction may be so indicated by a “false” value in the correspondingVCM register element.

A “false” value in the corresponding VCM register element may cause adelay in processing or result in incorrect processor behavior, in whichcase, the mask value stored in the VCM contents may be sent to thememory system. In one embodiment, only operands that have yet to beoperated upon will be loaded from memory and processed. In oneembodiment, when the retirement unit receives completed data from theexecution unit, and updates the corresponding element of the VCM maskfor this operation, by setting it to a “false” value.

In one embodiment, if an operand cannot be operated on (e.g., theoperand is not available in physical memory), a failure to completeoperation will be signaled to the retirement unit. In one embodiment,when the retirement units received a failure signal, it will savearchitectural state (e.g. register values, program counter value,failing instructions, VCM vector values, etc.). Then the processor maybe flushed of all current operations and restarted, such that a routinewill be performed to acquire the missing operands from memory.

When the missing operands have been acquired, the processor may berestarted in the saved state. The VCM vector may then be updated suchthat processing will start with exactly the operand that was failing.

In one embodiment, the VCM register for an operation can be renamed toallow multiple instructions to be executing concurrently. Therefore, theretirement unit may update the appropriate renamed VCM register for theinstructions using the VCM register. If a failure occurs, theappropriate renamed VCM register may be saved to memory and later usedto restart the processor in the appropriate state.

FIG. 2 is a diagram of a method 200 to handle and to manage thecompletion of vector operations, according to an example embodiment. Themethod 200 (hereinafter “vector completion mask (VCM) service”) isimplemented within a machine-accessible medium and operational within amachine. Optionally, the VCM service processes over a network that maybe wired, wireless, or a combination of wired and wireless. According toan embodiment, the VCM service is integrated as a sub service or featurewithin a vector processor hardware or vector processor's instruction setor firmware. So, existing vector architectures may be enhanced toperform the processing of the VCM service.

Initially, at 210, the VCM service associates multiple operands for asingle operation within a processor. That is, the VCM service identifiesaddresses or identifiers for obtaining operands associated with anoperation that the processor is executing or is about to execute withina machine or device.

According to an embodiment, at 211, the VCM service initializes a stringof bits associated with a data structure by setting each bit of thatdata structure to a logical “1” value (turning the bits on or settingthem). The identity of that data structure is obtained and is acquiredfor evaluation, at 212, in response to an identifier associated with theoperation, which the processor is executing or is about to executewithin the machine or device.

The data structure may be viewed as a bit mask or array, such that eachoperation supported by the processor's instruction set, or someconfigurable subset thereof, includes its own unique data structure orbit mask. Each mask, field, or bit within the data structure refers to aspecific one of the operands of the operation that the processor isexecuting or is about to execute.

The data structure presented is demonstrated more completely herein andbelow. Essentially the data structure serves as a mechanism or conduitfrom which the processor may continue to make forward progress on anoperation that is being executed in a vector computing environment withmultiple operands, when the operands are available or at least some ofthose operands are available to the processor during different cycles ofthe processor. Of course forward progress assumes that during eachiteration at least one new operand that was previously unavailablebecomes available.

It is also noted that although some embodiments discussed herein referto the bits or flags associated with operands as being unset to indicatean that operation has been successfully processed and set to indicatethat an operation has not been successfully processed, the embodimentsare not so limited. That is, the bits may be set to reflect an operationprocessed and unset to indicate that an operation has not yet processed.Any consistent convention may be used with the teachings presentedherein.

At 220, the VCM service uses the processor to process the operation witheach of the multiple operands that are available. So, if the operationhad 10 operands and the processor successfully retrieved 7 operands frommemory or registers, then the operation is processed with those 7operands and the temporary or running results retained in memory.

At 230, the VCM service clears each flag or bit within the datastructure for the corresponding operands that were successfullyprocessed by the processor. So, in our example, the data structure wouldat this point have a 10 bit data structure where each bit corresponds toa particular operand. Seven of those bits or flags are cleared or set tozero and three of those bits or flags are set to one. The three set toone reflect operands that have not successfully processed or completedwith the operation.

If at this point each of the flags or bits of the data structure werecleared, then, at 241, the processing for the operation that isexecuting within the processor would stop. This is an indication thateach of the operands for the given operation has been successfullyhandled by the processor and the VCM service.

However, at 240, if (as is the case with the running example) someoperands are not available during the first iteration or cycle of theprocessor, then these operations have to be acquired and processed.Operands may not be available to the processor during an execution cyclefor a variety of reasons. For example, suppose the operation beingprocessed is loading data and some of that data is not immediatelyavailable in memory to the processor. In such a case, the VCM service,in connection with other aspects of the processor's instruction set, maydetect, at 242, a page fault for those operands (pieces of data) thatare not available for a processing cycle.

Therefore, if some operands are unavailable during a processing cycle,then the operands that are available are processed and the running ortemporary results retained so as to maintain forward progress of theprocessor. The VCM service then, at 243, flushes the contents of theprocessor or restarts a processing cycle. At 244, the data structure isagain evaluated and each unprocessed and previously unavailable operandis identified within the data structure as having a set flag. Theprocessor again attempts to acquire each of these operands that stillhave to be processed, such that processing begins or starts again at220. The VCM iterates for multiple processing cycles of the processoruntil each bit or flag within the data structure is unset, whichindicates that the operation has processed each of the operands that itwas suppose to process. It is noted that anywhere from one to severalprocessing cycles may occur.

The processing of the VCM service demonstrates how the instruction setof a processor may be augmented with a data structure that maintains thecompletion state of operands vis-à-vis an operation to which theyrelate. Thus, a vector computing technique may be realized within vectormachine architectures where operations are continually experiencingforward progress during each cycle of the processor even when someoperands for an operation are missing or are otherwise unavailableduring any particular processing cycle while others are available.

FIG. 3 is a diagram of another method 300 to handle and to manage thecompletion of vector operations, according to an example embodiment. Themethod 300 is implemented as instructions within a machine-accessibleand readable medium and is, optionally, operational over a network(wired, wireless, or a combination of wired and wireless).

The instructions may reside in removable media and processed when themedia is interfaced to a machine and uploaded into the machine forprocessing. Alternatively, the instructions may be prefabricated withinmemory or storage of a machine. Still further, the instructions mayreside on one network machine and be downloaded over a network toanother network machine for processing. In another situation, theinstructions may reside on one network machine and be processed at thedirection of another machine.

The processing of the instructions presents an alternative to the VCMservice represented by the method 300 of the FIG. 3. It is also to benoted that the method 300 may also be implemented within removable mediaand subsequently interfaced to a machine for processing.

At 310, the instructions identify a plurality of operands associatedwith vector processing of a processor. The operands are associated witha single operation that the processor executes in a single cycle.

At 320, the instructions identify the VCM for the operation associatedwith the operands. That is, the specific VCM that the instructionsacquire for management and inspection in connection with the operationis identified in response to an identifier for the operation. Theoperands are associated with the operation.

At 330, the instructions attempt to acquire the operands that have setbits identified within the VCM. So, the processor may have alreadypartially processed the operands associated with the operation in aprior iteration or cycle. The processor makes forward progress againstthe operands and communicates the forward progress back to itself in asubsequent cycle via information communicated and managed within the VCMfor the operation being processed.

Therefore, if any operands have already been processed with theoperation then their corresponding bit values or flags are cleared orset to a binary zero within the VCM (unset). It is again noted, that theopposite could just as likely occur. That is, the operands that havealready been processed with the operation could be identified within theVCM as bits that are set to ones or turned on. So, at 331, theinstructions ensure that for successfully retrieved operands within thelist of operands that are still needed for an operation, those operandshave their corresponding bits of flags within the VCM cleared (unset).Again, this ensures that on subsequent iterations of the processor theoperands that have already been processed with the operation are notagain reprocessed. The technique of using the VCM ensures that theprocessor is making forward progress during each cycle or iteration forany given operation that is be processed using a vector computingtechnique, assuming at least some operands are available during a cycleof operation that were not previously available.

At 340, the operation associated with the VCM is processed against eachof the operands that were successfully acquired or available withinmemory for the processor to handle. If at this point each of the bits inthe VCM is cleared, then this is an indication that the operation hascompletely and totally been handled by the processor and instructions.

However, at 350, if even a single bit remains set or equal to one withinthe VCM, then this is an indication that the processor still needs toretrieve operands in order to fully complete the operation associatedwith the VCM. Thus, the processor's contents are cleared or flushed and,at 351, the processing is restarted at 330. This iteration continuesuntil each bit or flag within the VCM for a given operation is cleared,which indicates that the each operand for a given operation has beenprocessed by the processor.

During each iteration or processing cycle for the processor forwardprogress is being made within the processor (assuming at least onepreviously unavailable operand is newly available during each cycle).That is, one or more operands are retrieved and processed and thetemporary results housed and maintained for use in subsequentiterations. This forward progress continues until the processor hascompleted an operation with each of the operands associated with theoperation being handled, and the operation being handled is associatedwith a specific VCM. The VCM provides a mechanism by which the forwardprogress can be managed in a real time and dynamic fashion. Theinstructions facilitate the management of the VCM for each operation forwhich a VCM is associated.

According to an embodiment, the instructions are a sub service or subfeature of a vector processor's instruction set. So, the instructionspermit the vector processor to manage and handle the VCM, or a singleVCM for each operation that is processed in a vector computing manner.

FIG. 4 is a diagram of vector completion mask handling apparatus 400,according to an example embodiment. The vector completion mask handlingapparatus 400 is implemented in a machine-accessible and readablemedium. In an embodiment, the vector completion mask handling apparatus400 implements the methods 200 and 300 of FIGS. 2 and 3.

The vector completion mask handling apparatus 400 includes a processor401 and a VCM 402A. The vector completion mask handling apparatus 400interacts or interfaces with an operation 402B and operands 403C, whichare associated with the operation 402B. Each of the components of thevector completion mask handling apparatus 400 will now be discussed inturn.

The processor 401 is a processor that is enabled or architected tohandle vector computing. So, the processor 401 is capable of organizinginstructions, when appropriate, to process a single operation 402B usingmultiple operands 402C. However, unlike conventional vector enabledprocessors, the processor 301 includes a modified instruction set orservice that manages and utilizes a VCM 402A to maintain and experienceforward progress with respect to processing the operation 402B and theoperands 402C during iterations or cycles of the processor 301 (assumingat least some operands 402C that were unavailable during a prior cycleof operation become available during a new or next cycle of operationfor the processor 401).

The VCM 402A is a data structure, such as a mask bit array. The VCM 402Ais associated with a particular operation 402B. It is noted that theprocessor 401 may handle a plurality of operations 402B, and each uniqueoperation 402B is associated with a different instance of a VCM 402A.Each operation 402B will also have its own set of operands 402C.

The VCM 402A includes a bit or flag that uniquely identifies aparticular one of the operands 402C. Any convention may be used by theprocessor 401 to indicate via the bits or the flags whether operands403C have already been processed with the operation 402B or whetheroperands 403C are still unprocessed or unhandled with the operation402B.

According to an embodiment, the processor 401 initially sets all thebits of the VCM 402A to be one or to be on. This is an indication thatthe processor 401 has not processed the operation 402B against any ofthe operands 402C. This is typically done during initialization orbefore the processor 401 has started against the operands 402C and theoperation 402B.

As the processor 401 is successfully acquiring operands 402B and issuccessful in processing the acquired operands 402B against or with theoperation 402C, the processor 401 clears the appropriate bits or flagsassociated with successfully processed operands 402C. If there are anyremaining bits or flags that are still set at the conclusion of a cycleor iteration of the processor 401, then the processor 401 saves thetemporary or running results and clears its contents or memory andrestarts another cycle. In this next cycle, the same operands 402B thatwere previously successfully acquired and processed are not re-handledor re-acquired because the VCM 402A maintains the forward progress andinforms or instructs the processor 401 to acquire operands 402C notpreviously and successfully processed by the processor 401 during aprior cycle or iteration of the processor 401.

In this manner, the processor 401 is continually making forward progressagainst the operands 402C of the operation 402B, even when not each ofthe operands 402C are available for processing against the operation402B during a particular processing cycle of the operation 403B (but atleast some previously unavailable operands 402C become available duringa new processing cycle of the processor 401).

FIG. 5 is a diagram of a vector completion mask handling system 500,according to an example embodiment. The vector completion mask handlingsystem 500 is implemented in a machine-accessible and readable medium.The vector completion mask handling system 500 includes the vectorcompletion mask apparatus 500 of the FIG. 5 and includes some otheradditional components.

The vector completion mask handling system 500 includes a processor 501,a VCM 502A, and memory 503. The vector completion mask handling system500 also interacts with an operation 502B and operands 502C associatedwith the VCM 502A. In some embodiments, the vector completion maskhandling system 500 may also include a log 504. Each of these will nowbe discussed in turn.

The processor 501 interacts in a manner similar to what has beendiscussed above with respect to the methods 100, 200 and the system 300of the FIGS. 1-3. The processor 501 is enabled or architected to performvector computing. The processor 501 is also modified to handle andmanage the state associated with the VCM 502A.

The VCM 502A is associated with a particular operation 502B, and itincludes identifiers, via bits or flags, that uniquely identifies eachoperand 502C associated with a given operation 502B.

The processor 501 manages the VCM 502A within memory 503. The VCM 502Amaintains states and thus forward progress for a given operation 502B byidentifying which operands 502C have been successfully acquired andprocessed by the processor 501 during a prior processor iteration orcycle.

According to an embodiment, the vector completion mask handling system500 also includes a log 504. The log 504 may include the states ortransitions of the VCM 502A. So, the processor 501 writes states orvalues for the VCM 502A during each processing cycle or iteration to thelog 504. The log 504 may then be inspected or analyzed if problems orefficiency issues arise. In an embodiment, the processor 501 may alsoperiodically issue instructions of directives to flush the log 504 frommemory 503 or storage to a printer.

It is now appreciated how vector architectures may be enhanced tocontinue to experience forward progress in the completion of anoperation even if during any particular cycle of the architecture thereare some operands that are unavailable for processing for thatparticular cycle.

The above description is illustrative, and not restrictive. Many otherembodiments will be apparent to those of skill in the art upon reviewingthe above description. The scope of embodiments of the invention shouldtherefore be determined with reference to the appended claims, alongwith the full scope of equivalents to which such claims are entitled.

The Abstract is provided to comply with 37 C.F.R. §1.72(b) in order toallow the reader to quickly ascertain the nature and gist of thetechnical disclosure. It is submitted with the understanding that itwill not be used to interpret or limit the scope or meaning of theclaims.

In the foregoing description of the embodiments, various features aregrouped together in a single embodiment for the purpose of streamliningthe disclosure. This method of disclosure is not to be interpreted asreflecting an intention that the claimed embodiments of the inventionhave more features than are expressly recited in each claim. Rather, asthe following claims reflect, inventive subject matter may lie in lessthan all features of a single disclosed embodiment. Thus the followingclaims are hereby incorporated into the Description of the Embodiments,with each claim standing on its own as a separate exemplary embodiment.

1. A method, comprising: associating multiple operands with a singleoperation within a processor; processing the operation with each of theoperands that are available to process; and clearing a flag within adata structure for each operand that is successfully processed with theoperation.
 2. The method of claim 1 further comprising, flushingcontents of the processor; evaluating the data structure to reprocessthe operation for select ones of the operands that are identified withinthe data structure as having set flags; and clearing a set flag withinthe data structure for each operand that is successfully processed withthe operation.
 3. The method of claim 2 further comprising, iteratingthe processing until each flag within the data structure is cleared orunset.
 4. The method of claim 1, wherein clearing further includeswriting a zero bit in a field within the data structure for each of theoperands that successfully processes with the operation.
 5. The methodof claim 1 further comprising, initializing the data structure bysetting each bit within the data structure to one, wherein each bitcorresponds to a unique one of the multiple operands.
 6. The method ofclaim 1 further comprising, identifying the data structure in responseto an identifier associated with the operation.
 7. The method of claim 1further comprising, detecting page faults with a number of the operandswhile the operation processes indicating that those particular operandsare not available in memory for processing and leaving flags associatedwith these operands unchanged within the data structure.
 8. A machineaccessible medium having associated instructions, which when processed,result in a machine performing: identifying operands for an operationthat is to be executed within a processor; acquiring a vector completionmask for the operation; attempting to retrieve ones of the operands thathave corresponding bits set within the vector completion mask; andprocessing the operation within the processor with the successfullyretrieved operands.
 9. The medium of claim 8, further includinginstructions for unsetting the corresponding bits within the vectorcompletion mask for the successfully retrieved operands.
 10. The mediumof claim 9 further including instructions for flushing contents of theprocessor after processing the operation if a remaining operand has itscorresponding bit still set within the vector completion mask.
 11. Themedium of claim 10 further including instructions for restarting theprocessing associated with attempting to retrieve the operands and withprocessing the operation within the processor if a operand has itscorresponding bit set within the vector completion mask.
 12. The mediumof claim 11, further including instructions for iterating the processingassociated with restarting until each bit within the vector completionmask is unset.
 13. An apparatus, comprising: a processor; and a vectorcompletion mask (VCM), wherein the VCM is to be accessible to theprocessor and is to be managed by the processor, and wherein theprocessor is to unset bits of the VCM if operands associated with thebits are successfully retrieved and processed with an operation.
 14. Theapparatus of claim 13, wherein each bit of the VCM is to be initiallyset by the processor before the processor is to process the operationfor a first time.
 15. The apparatus of claim 13, wherein the processoris to reset, is to re-evaluate the VCM, and is to re-process theoperation if after a prior execution of the operation a set bit withinthe VCM remains.
 16. The apparatus of claim 15, wherein a state of theVCM is to be maintained by the processor.
 17. The apparatus of claim 13,wherein the VCM is a bit array data structure each bit uniquelyassociated with a particular one of the operands of the operation. 18.The apparatus of claim 13 further comprising, a plurality of additionalVCM's, wherein each additional VCM is associated with a unique andadditional operation, and wherein the processor is to manage theadditional VCM's.
 19. A system, comprising: a processor; a vectorcompletion mask (VCM), wherein the VCM is to be accessible to theprocessor and is to be managed by the processor, and wherein theprocessor is to unset bits of the VCM if operands associated with thebits are successfully retrieved and processed with an operation; andmemory, wherein the VCM is to be managed by the processor from thememory.
 20. The system of claim 19 further comprising, a log, whereinthe processor is to write states of the VCM to the log and the log is tobe periodically flushed from the memory to storage by the processor. 21.The system of claim 20, wherein the log is to be transmitted to aprinter by the processor.